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ABSTRACT 

This study defined a type in for ma t ion- process i no 

task analysis and an index relating different instructional seouenc<^s 
to this analysis. On^ hundred sixty-'^cur colleae students wer»' 
taught, with comnuter-assisted instruction, an imaoinarv science by 
various instructional seouences or by selecting their own seauence. A 
oroqrair-cont relied instructional sequence confornina to the sequence 
defined bv the task analysis was mo^t effective. Learn<^r-cont rolled 
sequences yielded poor performance, '^bo contributions of the 
cognitive abilities of induction, associative mefr^orv, and qeneral 
reasoning to performance under learner and prouram-controllea 
sequence and the ability by sequence interactions were shown. (Author) 
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The relationship of the learning tash structure to the instructional sequence vas of major 
importance to this investigation. Several studies have found that following an instructional se^ 
quence defined by a Gagn^' type behavioral tash analysis has reduced error rate during learning, 
but no clear advantage for following a hierarchical learning sequence has been found on a criterion 
measure following learning. Examples of this class of studies have been Gavurin i Donahue (1961) i 
Hiller (1965); Payne, Krathwohl £ Gordon (1967); Wodthe, Brown, Sands & Fredericks (1967); and 
Heidermeyer, Brown £ Sultzen (1969) . Error rate may be a meaningful index of the effects of dis* 
ordered sequences since it can reflect, in part, the instructional item transfer interdependency 
relationships within a task structured bya Gagne type analyses. The studies (Aoe, Case £ Roe, 

1962j Levin £ Baker, 196:^j Uewton £ Hic)cey, 1965; Payne , Krathwohl £ Cordon, 1967; e,iv3 Kodtkc, 
Brown, Sands and Fredericks, 1967) which acciunulated error rate data and found no differences in 
error rate between hierarchical and disordered sequences of instruction also reported no criterion 
differences in performance. Hamilton (1964) did not report error rate data, but she did not find 
an effect for Instructional sequence. 

These findings could be due to task variables, the method of task analysis, methods of 
sentation (e.g. overcueing), individual differences (e.g* prior task related knowledge and/or 
ability differences) , or the invalidity of the assumption that certain instructional sequences 
will improve task performance. Some studies have in fact indicated a possible instructiOf^al se* 
quence by ability interaction. (Stolurow, 1964 and Levin £ Baker, 1963) . 

Various studies have allowed the learner to determine his own instructional sequence and have 
demonstrated little or no difference totween learner selected sequences and instructional sequences 
determined by a Gagne^ tyi'e analysis (Camphell, 1964; Camploll £ Chapman, 1967; Judd, Bunderton £ 
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t Bessentf 1970; and Barnes* 1970) . A few studies have indicated a positive effect for learner 
control (Mager/ 1961; Mager & McCann* 1961; Dean* 1969; and Grubb* 1969}* but in general these 
have incorporated r\ore learner control than just control over instructional sequence. 

This investigation was designed to: 

1) determine a method of task analysis which could imply an instructional sequence for op- 
timizing performance on a complex criterion task* 

2) define an index which would quantify the proximity of a student's learning sequence to 
the sequence defined by the task analysis* 

3) determine how different degrees of a non-hierarchical program^controlled instructional 
sequence affects performance* 

4) determine the relationship between learner-selected instructional sequences and program- 
controlled instructional sequences* and 

5) determine the relative contributions d. several cognitive abilities to different learner 
and ^gran-controlled instructional sequences. 

Structural Analysis 

At first the Gagn^ method appeared to be superior to the other existing methods for deter- 
mining the task structure* since it was more objective and had received some empirical support. 
However* when the Gagn^ analysis was used at The University of Texas* low interjudge reliability 
of structure determination resulted. The experience gained in trying to perform a task analysis 
which used the Gagn^ method led this author to lock for a more reliable method than an analysis 
of the **learning hierarchy**. This low inter judge reliability of structure determination may have 
occurred since the skills to be lesrned were restricted to two of the highest levels in the cagn^ 
hierarchy* concepts & principles. GagnC has not suggested arty analytic procedures to work within 
a given level of his hierarchy. 

The following method was defined as an attempt to determine the structure of a task which 
would be objective and would lead to an ordering of steps which %/ou)d be reproducable reliably. 

If one starts with the terminal objective and asks what is the first processing step that 
should be performed to achieve the terminal objective* then asks what are the succeeding s< dps one 
St a time* one can derive a flow of information processing that must occur to reach the terminal 
objective. This anslysis takes s highly specific terminsl objective and breaks it down into a set 
of processing steps which are ordered by inputs snd outputs. Process step "x** would be ordered 
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before process step *'y" if the output of step "x" were required as input to step 

The task used in this study was considered to be the learning of an algorithnij because rules 
of computation were learned. The terminal objective for the student was similar to that used by 
Merrill (196&) . to achieve this objectivei S ne«:ded to use different computational rules in a 
specific sequence. 

An Imaginary Science 

The imaginary science called the Science of Xenograde Systems (Merrilli 1963) was chosen for 
this study. The science can be used in research to bridge basic learning research on one side and 
curriculum development on the other. The science has the properties of both being somev'hat meaning- 
ful while having good experimental control. 

The newly defined procedure of information-processing analysis was followed to produce a flow 
diagram of the Xenograde Science. The first attempt produced a leas efficient algorithm than the 
final version. The process used to achieve the final diagram was an iterative one with several 
revisions before arriving at the end result. There might be a more efficient algorithm than the 
one used/ but this one appeared good. The next step was to program the algorithm in the FOKTRAN-IV 
programming language. To test the rationality of the flow diagram the program was executed by a 
computer. The resulting output was checked for many different initial conditions and the program 
consistently produced the correct results. Support thus was provided for the validity of the 
algorithm. The computer program was not a necessary step in testing the rationality of the diagram, 
but the computer program did provide an efficient means of generating examples and test items for 
Instructional use. 

The next consideration was to break the flow diagram into smaller steps or units which could 
be taught. The diagram was fragmented so that only one decision had to be made at any given step. 
This fragmenting procedure involves the instructional analyst in the consideration of step sirer 
which may be unavoidably an empirical question. 

A verbal rule was written from each of the steps thus derived. This procedure produced ten 
rules. 

Other methods for determining the structure of a task did not seen to have the characteristic 
of reproducabi llty of ordering the subtas)cs once they were defined. The information-processing 
analysis takes a subject ratter expert, but it is thought to be an objective method. If a group 
of analysts of similar experience with the subject natter were given the terminal objectives, the 
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subtasks or rulet^i and the procedure for performing the analysis they should derive essentially 
ttiC same order, rour people used the procedures and independently derived the same order. 

A validation of this analysis was the next consideration, since h satisfactory procedure for 
the information-processing analysis was attain3d« To determine if this structural analysis yielded 
some instructional benefit. It vas necessary to quantify the degree of proximity to cr departure 
from this sequence. 

Quantification of Instructional Sequences ~ The HSCI 

It seemed reasonable to assume that there were measurably different sequences of presentation 
which ranged from strict adherence to the task atr^icture to a completely reversed sequence. An 
index which would specify the degree of conformity of a presentation to the task structure was 
strongly indicated. 

It should be remenbered that one result of an information-processing task analysis is a flow 
diagram which consists of the processing diagramed as nodes and lines ^;«hich show the intercon- 
nection of the nodes. The lover level nodes are inputs, which implies their being prerequisite, 
to the higher level nodes into which they are connected. A given subject matter may be composed 
of a number of these prerequisite units interconnected in various ways. 

A unit in the hierarchy could be specified as a terminal node and all of the independent 
nodes which immediately preceded. Zt is the assembly of these units upon which the hierarchlal 
sequence conformity index (KSCI) Is based. Figure I shows the formula for determining the ksCI . 



N 




K 




Kumber of prerequisite nodes required 
before a terminal node 



N 



Khere N * the number of prerequisite units in the task, 

Wpn ■ the weight of any given prerequisite node, 
and X «^the number of prerequisite nodes actually attained before 
a terminal node. 



Figure 1* The H5ri formula 

The HSCI would have a value of W (the mean weight) if all prerequisites in a hleratchy w*ere 
attained prior to attempting a higher level, w vrould t>e 1.00 if all weights v^re 1.00, as they 

vere a.surred to b« In thl» .tudy. The lisci vould h»ve e value of fl.oo If no prr>requl.lte. in a 
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hierarchy were attained prior to attempting a higher level. Tor KSCI * 0.00 it would be necessary 
for the sequence of instruction to progress in a reverse hierarchial order. This reverse order 
is the only sequence that would yield a value of zero. Therefore^ K5CI ringes frocn zero to unity. 
Intermediate values for the KSCI would he attained by various degrees of nonconformity to a hier* 
archial presentation. 

At the present state of hnowledge« an assumption of equal weight for all contributing pre^ 
requisite nodes within a prerequisite unit must be made. The index gives less weight to any 
single prerequisite node when the number of prerequisite nodes in a prerequisite unit increases. 

There is no way of telling whether oi not the task used in this study did violence to tha 
assumption of equal weight without obtaining extensive difficulty statistics for each node and 
transfer statistics between nodes. 

The validity of the index as a meaningful index of systematic variation xn sr:quencing was 
supported by pilot research, A pilot study demonstrated that the KSc; was linearly related to 
terminal performance for values of the KSCI from 0.50 to 1.00 under program control. 



METHOD 

Subjects 

Students in five self-paced introductory psychology classes for secondary school teachers 
at thu University of Texas at Austin were required to participate. A total of 176 Ss were ini- 
tially tested and a total of 164 Ss completed the experiment. Several Ss had to be discarded 
because of computer malfunctions and several because of illness. Some of the retention test« 
transfer test# and attitude questionnaire data was lost due to oversight on the part of proctors 
assisting the experimenter. 

Ability Measures 

Tests to mark the abilities of interest in this study were selected from the Trench^ Ekstrom 
4 Price tl963) Xlt, Associate Memory was marked by the 0bject-hhjT\ler Test and by the First and 
Last Hanes Test . Induction was marked by the Letter Sets Test and by the Locations Test . General 
Reasoning was marked by the Ship Destination Test , the N ecessary Arit^etic Operations Test # and 
the Mathematics Aptitude Test . 

To obtain tliS predicted factors froei the test balteryf It was decided to use a principal axis 
factor itnalyals followed by s varimax rotation. 
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Experimental Task 

Merrill (I96&) developed a complex ima 9 inary science for learning research called the 
science Xenograde Systems. Merrill's version of the science contains three satellites which 
revolve about a nucleus containing particles called alphons. The laws and relationships among the 
various components of the system comprise the subject matter of the science. 

A simulation program for the IBM 1300/1600 Instructional System was developed at the Com* 
puter^Assisted Instruction Laboratory# The University of Texas* In a series of pilot studies the 
science was found to be very difficult for £s to learn. This study used a liighly modified version 
of the science which simplified the content such that learning of the entire science occurred in 
one hour or less# rather than the four hours needed for earlier versions of the science. 
Instructional Equipment 

Instruction was administered by the IBM 1300/1600 Instructional System. Presentation of 
materials was by means of a cathode ray tube display# a computer-controlled image projector# and 
by mimeographed handouts. Student responses were entered by means of a keyboard at the computer 
terminal. Other responses were recorded on mimeographed forms with pencil. 

Design 

A pilct study using a design similar to the present one with 49 students from introductory 
psychology courses Indicated that the KSCI might be a valid index related to performance and that 
the other queutions were worth pursuing. Support for the validity of the }!SCI in the pilot study 
came from a linear trend for the KSCI to be positively related to performance over the range 
{0.30 - 1.00) of the HSCI values sampled when sequence was under program control. 

In the current study one group called the self-selected (5S) group was used which allowed 
S to choose his own sequence of rules. The s was also allowed to repeat Individual rules; althouah 
with each repetition the example was different. Tvx> related representations of the structure of the 
imaginary science were provided S. A flow diagram of the task ar.d a list of the behavioral ob- 
jectives of each of the ten "lessons" (rules) served as the two representations. Tor comparison 
anothrr group was yoked S for S to group SS. This yoked (V) group was not provided with the repre- 
sentations of the task. A member of group Y was given the sequence determined bv the subject to 
which he v*as randomly matched. He received the same numl^r of examples on each rule in the same 
order as his randomly paired s in group SS had chosen. It waa expected that uneven distributions of 
Ss classified by HSCI would result for group SS and thus for group Y. Although the availability of 
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a task representation was not thought to he a major variable affecting performance in group Y, two 
other groups were included to confirm this ass’jimptloni These two forced sequence (P) groups v^re 
included to determine the effect of the represr^ntatlons on performance when the sequence of instruc- 
tion was previously determined and no repetitions of any rule were allowed. Equal distributions 
of Ss clattsified by HSCI were established for the two F groups* * If no difference was detected be- 
tween the two F groups then the effect of the representation could be considered nil and the two 
F groups at each level of f'le KSCI for a predetermined sequence could be combined. The combined 
F group witli group Y then would be compared to group SS to determine the relative effects of self- 
selection and program control of sequence. 

Tb3 p^sttest designed to test the terminal objective was given on the computer. The ter- 
minal objective itt given the initial conditions of hCN, ACS* Distance^ and Force Field (F F) » the 
student will be able to produce a complete table of Xenograde readings line by line from time zero 
up to any sx^ecified time. Each successive line in a Xenograde table requires information from the 
preceding line* Because of this* correct scoring required a preceding line to be correct or the 
following J ine would also be In error. Thus, student errors wero scored by the computer program 
and corrected immediately. This in effect resulted In a correction procedure which could intro- 
duce learrtlng into the posttest measurement situation* A control (C) group was necessary to assess 
the effect of the correction procedure, One group was assigned the task of taking the posttest 
without any instruction, except how to operate the computer terminal* It was assumed that learning 
in group C would be due to the corrective feedback following errors* The mean score for this group 
was used as a base level of performance on the posttest. 

Table 1 is a summary of the experimental design whowlng the differences and eimilaritiea of 
treatment among the groups during the learning phase. 

Table I 

Sunrary of the Experimental Design 

Kvnber of times a structural Repre- Predetermined 

Group rule could be taken sentation Available sequence? 

tel f-<;elcctrd n* 

YoVcl (Y> n* 

forced vitJicnt ronresenf.-^tten (rp) 1 

rorco<^ v'ith representation (F^l 1 

rmirol <C) r 

• Subjects in group SS may repeat any given rule n times, where 
The subject randomly »^atched to a S In group SS received the corresponding 
rule the same number of times. 



yo!» 


no 


r/> 


yo8 


rio 


yes 


VOS 


ves 


no 


- . 




f 



8 



Dependent Measures 

Various indices of performance vere taken. These Included a posttest# retention test taken 
two weeks after the posttestr \ transfer test taken after the retention test» and an attitude 
questionnaire. 

T ime to learn the science . The lenqth of time from presentation of the first rule until 
the student completed the instruction was accumulated to indicate the total time spent by the stu- 
dent in the task. 

Posttest - rete nt ion test . The test of the terminal objective (posttest or retention test) 
contained either 1S2 or 144 items. Since the test had to be given twice to each S^r tvo forms vere 
desired. No statistics were available as to whether the tests were parallel or not; therefore half 
of each group received one form and one-half the other form for the posttest. To measure retention 
S completed the form which he had not previously taken. The tests were constructed so that the same 
behavior was measured with comparative ftequency by both forma. 

The test required S to fill in each entry in a table# line by line by keying entries which 
appeared in context in the table on a cathode ray tube. After completing a line S was informed of 
hiu incorrect responsCiS# and the correct answer replaced any incorrect ones. No specific feedback 
action was taken if £'s answer was correct. As toon at S completed the test he was told how many 
items he had answered correctly. This total score was converted to percent correct and used for 
the primary analysis as a measure of overall proficiency for the posttest and as the only criterion 
for retention, iho con'^ersion to percent correct allowed the two alternate forms of the test to 
be compared since there was a small difference in the total nusJ^r of ilemf between the two forms. 

Transfer tes t. The transfer test required S to infer three new rules of the science given 
two example tables. The subject then cocrpleted nine test items of the same format as was used 
for teit questions during ths science instruction. Fifteen minutes were sllowed for this task# and 
the total nuTvler correct was used as the dependent measure. 

Attitude questionnaire . The attitude questionnaire was a checklist consisting of ten items. 
Ten statements related to the task vere given and f had to mark a four choice scale ranging from 
'strongly agree” to "strongly disagree". 
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Procedure 

During five two'hour sessions large groups of Ss received a thirty minute lecture presenta- 
tion by E. The lecture covered an introduction to CAI* ability by treatment interaction studies* 
and the value of their participation in this study. These presentations were given in order to 
develop Ss interest in the study. Each S elected which one of the five sessions he wanted to attend 

Immediately following the lecture* S^s were tested on selected cognitive abilities. Seven 
tests from the battery (Frrnch et al.* 1963) were used to mar); the factors of Associative Memory* 
Induction* and General Reasoning. 

Following the testing Ss were told to make individual appointments at the Computer-Assisted 
Instruction Laboratory. Each S scheduled two appointments with a two week interval between appoint- 
ments. 

At the first session in the lab* £ was first given an introductory course administered by 
the computer which taught terminal operating conventions and procedures. It was hoped that the 
introductory course helped to desensltire ^ to the terminal and CAI before instruction began* 

After £ had completed the introductory course* he was given a booklet to read. This booklet 
gave an introduction to the Xenograde science* the justification for learning the science* some 
humorous background material* instruction for reading the computer terminal data displays* and 
group specific procedures. As soon as S finished readino the booklet* he took tho CAI program 
to learn the science. 

If S were in groups Y or F he was assigned a sequence of instruction by a proctor at the be- 
ginning of the computer -administered course. The science was composed of te.n ‘'lessons*' each of 
which consisted of one rule* an example* aiVl tliree test itf^ s. Simultaneously presented with eoch 
rule was a unique example. Khen S believed that he understood the rule* he indicated that be was 
ready for a test of the rule by typing the word “test" at the terminal keyboard. The subject was 
then required to type a numeral to fill in a miselng piece of data on a display. The item required 
the use of the rule to ^tain the correct answer. Following tliree such test items* ^ was informed 
of how mar.Y items he had answered correctly^ although he was not given the correct ansv*ers. The 
next rule was then presented and S vent through the same procedure. The subjects in one of the 
P groups (FR) were given the two representations* s flow diagram of the task structure and a list 
of behavioral objectives* and told to study then carefully before each rule-example presentation. 

At soon as the last rule was completed S vat told that he had completed the vaah end vae ready for 
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the postteat. The first lab session was completed as soon as £ completed the computer-administered 
posttest. 

Two veeXs after the first lab session S returned and took the alternate form of the computer- 
administered test (retention test) . After completing the retention test £ was given the mimeo- 
graphed transfer test. A mimeographed attitude questionnaire was then given to each £. 

At the beginning of the learning session £s in group SS were shown a diagram of the hierarchy. 
The behavioral objectives in their booklet corresponded to this diagram. After studying both re- 
presentations £ selected the lesson that he wanted to take by typing in a letter corresponding to 
the desired lesson at the keyboard. The rule and corresponding example were then presented. 
Following observation of this rule and example » S typed the word "test” %nd then completed the 
three test Items. After having been informed how many items he answered correctly £ was returned 
to the diagram of the hierarchy to select the next lesson. If £ selected the same rule again, he 
was given the same rule but a new example and different test i terns • His selection of the sequence 
of instruction continued until he indicated that he had taken at least one example of each rule 
and had done enough work to take the criterion test. The remaining tests and attitude questionnaire 
for group SS were the same as for the other groups. 

While taking the course i £s were not allowed to have any paper or pencils with them. 

Subjects were also asked to refrain from discussing the particulars of the course with others who 
were yet to take the course. 



RESULTS 



Because of the complexity uf the research design there was no simple test of each hypo- 
thesis. A difference between groups may in some cases have been due to several confounding factors. 
Each of the different dimensions along which groups varied (see Table 1) needed to be tested to 
eliminate alternate explanations of ar^y <^tained group differences. 

The primary performance criterion of interest was the total per cent correct on the posttest. 
Test of Variations in the Informatlon-Frocesstng Defined Sequence 

The first two-way classification (2x5) analysis of variance was computed with groups r? 
and FR as one factor and five levels of the HSCI at the other factor. No significant differences 
were found lor the groups or groups x HSCI Intertctlon. The IISCI factor yielded significant 
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effects for total percent correct on the posttest (F(4/42) • 2.60, £^.05). No effect for the 
HSCI was found for the time to learn criterion. The findings indicate that for a predetermined 
sequence the hypothesis of no effect of task representation (presence or absence of behavioral 
objectives and a flow diagram) on performance could not be rejected. 

The second two-way classification (2 x 5) analysis of variance was computed with groups F 
(FR and FR combined) and Y as one factor and the five levels of the HSCI as the other factor. No 
groups X HSCI interaction was fuund, but there was a significant difference between the F and Y 
groups in total time to learn the science (F(l/74) • 8.97, £^.005). The difference is not sur- 
prising since ^s in group F too\ only ten examples and £s in group Y too\ between ten and nineteen 
examples witli a mean of 11.4. The mean number of examples for group Y was significantly larger 
than the number of examples for group F • 4.85, £f • 51, £^.001 two-tail). Number of 
examples seemed to lengtiisn the amount of time to learn the science without significantly increasing 
criterion performance. The liSCI factor again yielded significant effects for the total per c. nt 
correct on the posttest (£(4/94) » 4.25, E< .005) , but no significant effects v.*ore detected for 
time to learn. 

T^e significant differences found which were attributable to the level of the K<:cx justified 
further inspection of the data. A non-hierarchical sequence, as defined by the HSCI, vould he any 
sequence having HSCI ^ l.(X). 

The first set of comparisons used HSCI * 1.00 vs. HSCI ^ 1.00. The combined preselected 
sequence groups (FR, FR, and Y) showed no significant mean differences. When each of the groups 
(FR, FR« and Y) v«re analyzed sex>arately only one produced significant differences. The scores for 
group FR vtre divided into two groups according to whether they received a hierarchical instruc- 
tional sequence (HSCI * 1.00) or not (HSCI / 1.00). An unequal ns test showed a significant 
difference for the total percent correct on the posttest (t » 3.30, 74, £^-01 two-tail) . 

No differences were found between the groups when time to learn was used as the criterion. The 
differences indicated higher mean performance when the HSCI was 1.00. 

Tests for the difference l.etveen the means at HSCI * 1.00 and the neajis at tha other values 
of the HSCI were calculated. 

Only the comparisons between groups for the HSCI • 1.00 and HSCI ■ 0.25 yielded significant 
results. The total per cent correct on the posttest • 2.72, df • 47, £^.01) was significant. 

The total attitude score did not reflect this significant difference, nor vera differences in 
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tine to learn detected. 

An apparent reversal in the trend for performance to decrease as HSCZ approached zero at 
KSCZ ■ 0.00 for a predetermined sequence was replicated by three independent groups (FAf FA# and Y) 
and also in t'le pilot data for this experiment. Although testing for differences in mean perform* 
ance between the HSCI « 0.00 and HSCZ • 0.25 produced no significant values » the multiple replica* 
tion of this ordering of the mean values suggests a stable phenomena. 

Learner and Program Controlled Sequences 

The lowest performance ot all the groups which studied the science was for group SS, and 
group C appeared to have a relatively high level of performance. A test of the mean differences 
between these groups yielded a highly significant result it » 3.6I| df » 59> £< .001) for the 
pcsttest total percent correct. 

Obviously a large percentage of the answers on the posttest can be "guessed" after observing 
the trends produced by the feedback procedure* but there still remains a highly significant number 
of items which are difficult to answer correctly without instruction. 

It would have been desirable to have used analysis of variance techniques* as in testing 
the first two hypotl^esesi but group SS failed to meet sampling assuinptions on the KSCZ factor. By 
interacting with the materials each £ determined his sequence rather than being randomly assigned 
a sequence and corresponding value of the K5CI. The only index of the linear relationship of the 
HSCZ to performance for group SS was the lac)c of correlation of the HSCI to the total per cent 
correct for the poattett (r * 0.03) . 

Disregarding classification on the HSCI* two*tail t tests were computed for the mean dif- 
ferences between groups Y and SS. Contrary to previous studies group Y was found to have superior 
performance. The total per cent correct on the posttest approached but did not quite reach a level 
of significance ■ 1.87* ^ • 102* E< .10). No differences were defected between groups Y and SS 
on the retention test* or transfer test. 

The other prediction was for a difference in the attitude toward the task. Ko difference 
in total attitude scale score was found. Of all the items on the attitude scale only one item 
discriminated the groups ■ 2.06* ^ • 93 * £^.05)* but the result w'^s in the c^oosite direction 
to that predicted. A more positive attitude was indicated by group Y. 

The difference which was detected between group Y and SS would seem to be attributable to 
the difference between self-selecting a sequence and being forced through a sequence. Table 1 
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showed that the 5S and Y groups also differed in respect to the presence of a diagramatic 

representation of the science which was the only difference between groups FR and fr. it seems 
reasonable to infer the difference between groups SS and Y was not due to the presence of the 

task representation. 

Cognitive Ability and Instructional Sequence 

This portion of the study required the application of several analytical procedures* First 
a factor analysis of the ability test battery was coonputed for purposes of ability construct 
validation. 

Factor analysis of the ability tests . The nsajor abilities of interest in this study were 
Induction and Associative Memory. The four tests used to mark these abilities as well as the 
three tests used to mark the General Reasoning ability were subjected to a principal components 
analysis. These factor loadings were then rotated by a varimax procedure. A clear factor 
structure yielded three factors interpreted as being General Reasoning^ Associative Kemory» and 
Induction. Factor scores for each individual were obtained and used in the subsequent analysis 
of the role of abilities. 

Contribution of abilities . Linear regression models (Bottenberg & Ward> 1963) were used 
to test questions concerning the contributions of abilities to performance and the interaction of 
abilities with the KSCI- The analysis was performed on pooled data from all Ss having a preset 
lected sequence of instruction. Ko differences were found among these groups on any criterion 
(except difference in time to learn the science betw'een groups F and Y) i therefore » it seemed 
justifiable to pool them for this analysis. 

For testing the hypothesis of ability by sequence (HSCl) interaction each ability measure 
was used separately# and tests were made to see if the regression lines of ability on the total 
percent correct on the po^ttest were parallel among the levels of the HSCl. 

The measure for Associative Memory yielded a full model >diich predicted better than just 
the mean score (F(10/dB) ■ 2«976# E< .005). The resulting ^ was 0*7S, 

tikiposing the restriction of parallel slopes for Memory scores among HSCl levels on the 
criterion produced a nonsignificant difference from the full model (P(4/S9) ^ l.ON 

The other abiMty by instructional sequence test was made using the Induction measure. The 
full model predicted the criterion score significantly better than just the mean score (F(10/68) 

• 4.070# £<.0005). The ^ for the full model was 0.32, 
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Imposing the restriction of parallel slopes for Induction scores among HSCI levels on the 
criterion produced a significant difference from the full model (P(4/88) ■ 2.90r £< .05) . The 
Induction ability was the only ability measure found to interact with the predetermined sequence 
of instruction as defined by the KSCl . In general Ss having low induction scores were more 
affected by progressively disordered sequences than were £s having high iriuction scores. 

The question of the "main" effect of an ability was not a meaningful question for the case 
of Induction. 

The criterion scores for the pi;«selected sequence group were split into two groups defined 
as being above or below the median Memory score for the total group. A two^tail t test indicated 
a difference <t « 2.39, df « 96, £< .02) between these groups. Consistently higher performance 
for the higher Memory scores across the HSCI. 

For the learner selected sequence a significant positive relationship (£ ■ 0.41, £^.01) 
between total per cent correct on the posttest and General Reasoning scores was found. A positive 
but smaller correlation (r ■ .22) was found for £s having a preselected sequence. 



DISCUSSION 



The information-processing analysis proved to be a reliable and an objective method in the 
sense that a number of persons independently arrived at the same sequence of steps once the ele- 
ments of the task structure were defined. The question of the validity of this analysis was not 
as clearly answered. It was predicted that if this information-processing analysis defined a 
sequence of instruction which improved learning performance, then as an index of conformity to 
hierarchical sequence (HSCI) decreased from 1.00 to 0.(X) performance would correspondinaly decrease 
This teat of the validity of the analysis assumed that the HSCI gives an ordinal measure of the 
degree of conformity to thie analysis. Any departure from the predicted result could be due to 
an Invalid analysis, an invalid KSCl, both the analysis and the HSCI invalid, or an invalid 
assumption that hierarchical sequences facilitate learning. 

Thie study did not euooort Neidermevet *e (1968) oonrlu«(rin that instructional sequence 
for relatively short programs is of minimal importance. 

In general, a covariation between the HSCI and performance was found for preselected 
sequences. This positive ccntriKjtion for a hierarchical instructional sequence held over time 
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and through the transfer test as well as yielding a more positive attitude for some Ss. The only 
seeninq inconaistercy of this relationship was the performance change at KSCI 0.00. Although 
not found to be a statistically significant change^ the same effect was independently observed 
in all predetermined sequence groups and in a pilot study. If this inconsistency were a real 
effect, then several possible explanations could be given. The KSCI may net accurately define 
the degree of conformity of the instructional sequence to the task analysis. There was, however; 
the predicted relationship over a major portion of the range of the HSCI (0.25'1.00). The KSCI 
has a value of 0.00 only when the instructional sequence is completely reversed from that of the 
information-processing analysis structure. This point where KSCI * 0.00 is easy to define 
independently of the HSCI as it is to define a sequence which progresses in an ordinal fashion 
through the structure. The only descriptive utility of the KSCI is for the interim range of 
disordinal sequences. 

There may have been a peculiarity of the terminal objective or of the entire task which had 
a facilitative effect for a completely reversed sequence. This alternative explanation could 
only be answered by a similar experimental design using another tas)^. 

It seems unlikely that the Intormatlon-processing analysis is completely invalid, since 
performance tended to covary with the index of proximity to the defined structure, the HSCI. 

A self-selected sequence of instruction did not produce a high level of performance as 
some studies had indicated it might. The lacX of correlation between the KSCI and performance 
for a self-selected sequence indicates the lack of a systematic effect of sequence on perfor- 
mance when S chooses his own sequence. It was found thit self-selection of sequence led to la^^er 
performance than a hierarchical predetermined sequence. The implication of this finding is that 
a t.isk analysis is a worthwhile endeavour; since it can lead to the definition of a hierarchical 
presentation sc^quence which increases performance, at least for some learner populations. 

It would be difficult to explain the low scores for group SS by stating that the repre- 
sent.itlon had no meaning for them; thus they had nothing to assist then in selecting their 
sequence. Group Y was given no representation, and the randtxnly matched s in group Y received 
the same steps in the sar.e sequence as the S from group SS to which he had been paired. The 
performance of group Y was significantly higher than that of group SS . It would seen that having 
the freedom to select one’s own sequence and repeat stepii which were unclear would be more 
meaningful and aid learning more than being shown steps in a sequence which bore no relationship 
to one's previous performance, but the data do not bear ti^is out. 
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The ta&k used in this study differed in several possible ways from the tasks used In the 
studies finding a benefit for learner-genersted sequences. This task used in this study was 
completely nev/ to all £s. In some of the previous studies (Mager* 1961; Mager s McCann# 1961) 
the Ss were fenniliar with some of the large units in the tas)c. In the study by Campbell and 
Chapman (1967J the learner-generated sequences were of only large units of a possibly non- 
hierarchical t^sX. The smaller steps were given as units of presequenced materials# and even 
then group discussions followed the individual learning sessions. This study was also conducted 
over a shorter time span than the studies finding a positive contribution for self-selected 
sequences. learners may need experience, and training to make self-selection of sequence beneficial 

Self-selection of sequence may be found to be a beneficial technique when used for selec- 
ting and sequencing missing units as in review# or when the task is not hierarchical# or when 
the steps to be sequenced are large steps composed of smaller presequenced materials# or when 
used over a longer time span# or any combination of the above. The technique of learner-generated 
sequence vras unsuccessful when the task was a relatively short# abstract# mathematical -scientific 
system taught as small steps and of which the students had no prior experience. 

To obtain enough £s for a meaningful analysis of the abilities the groups having a pre- 
determined sequence were combined. No difference on any dependent measure# except the time spent 
studying the science materials# was found among these three groups; so the decision to combine 
them seemed reasonable. The atatietically oignificant ordinal . interaction between the sequence 
of instruction# as defined by the HSCI# and the Induction scores had the generally expected shaf^e. 
It was expected that an individual who had a high measure on the Induction ability would be less 
affected by a d.isordinal sequence than would an individual having a low measure on this ability. 
Perhaps this ability facilitated the inducing of ordering of steps in the composite task which 
were not presented in an ordered manner. As the sequence M instruction became) more ordinal# a 
larger nuffOoer of the prerequisite steps were taken before the higher level staps thus reducing a 
reliance on an Induction ability. 

The Memory ability measure was not found to interact with the K5ri # but a hioher level 
seemed to increase performance scores relatively equally for any value of the KSCX . Aa $a Memory 
acuity increased Ms performance increased. This ability might have helped S rememhet the verbal 
rules which were taught# rather than the order of rulee oer se. As Pavne & Itrathwohl (1967) 
suggested# Memory and Induction made a positive contritotion to performance. 
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As was expocted t'^ere was a strong positive relationship between perfomance for qroun Ss 
and the Reasonino ability. It was expected that this neasure would aid in organixino and struc- 
turing the tasb to facilitate performance. Induction was also highlv related to perforr.ance for 
this qro'jp. It could be that by not following tho hierarchical strvjcture this ability was called 
upon in a siirilar manner to that described for the preselected seauence gr:>up. It could also 
have been that due to a lower level of learning, Induction was important in inducing the 
necessary behaviors from the Posttest feedback procedures, the Memory ability seemed to be 
unrelated to performance lor group SS. 
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